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» ABSTBACT 

Project PLAB* is a cosputer sanaged, indiYiduallzed 
learning systes developed by the Westinghouse Learning Corporation, 
and adopted in the St. Louis Public Schools, k sussatiTe evaluation 
of the systes was perforsed. The use of a cosputer in Project PLAB* 
alloMS the teacher sore tise to spend with individual students and 
contributes toward record keeping and feedback on student progress. 
Project PLAB* vas evaluated in the elementary grades using the 
Metropolitan Achievesent Test in grades 1, 2, 3 and using the Iowa 
Test of Basic Skills in grades <», 5, 6, 7. Affective seasures were 
also used to detersine the difference in the students* self-esteei, 
general anxiety, and test anxiety, other activities of the evaluation 
included student and teacher questionnaires and a cost analysis* 
Mixed results vers reported in the evaluation, sose of which could be 
attributed to known contasination of the data. (BH) 
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PROGRAM DESCRIPTION - G. Johnson 

.» 

PLAN* Is a computer managed Individualized learning program that allows 
each student to learn at his own rate In several subject areas at the 
same time. One of the outstanding featuretf'of the program Is that the 
entire I earn tng process receives dally guidance from an IBM computer. 
The computer helps the teacher plan student Instruction and keeps track 
of student progress' by scoring and analyzing tests, keeping up with pro- 
gress and providing day-to-day objectives for learning. 

PLAN* has two major goals. The first goat Is to provide each child with 
an individualized program of studies In Language Arts, Mathematics, Science 
and Social Studies. The teacher modifies the P.O.S. to fit the student*s 
particular needs. 

The second goal Is to involve students in making decisions and assuming 
.responsibility for their own learning. 

The school principal has full responsibility for PLAN* In his school. 
He selects and trains the teachers who are working PLAN*. 

There are two coordinators who assist the school principal by: 

1) working with the children and teachers..... 

and 

2) carrying out administrative tasks related to the 
Implementation of the program and coordination with 
evaluator and director. 

The project director Is responsible for every phase of the program. 



She reports to the Director of Curriculum Services, works with teachers 
and students, works with outside contracting agencies, makes recommendations 
for project changes, supervises writing curriculum materials and Is in 
charge of dissemination of the project Information, 

In PLAN* classrooms, there Is a variety of materials that are neither too 
hard nor too easy. Each child can proceed at his own pace. With an older 
child reading below grade level, a teacher chn maintain the child's Interest 
by adding enrichment and motivational activities to the learning units pro- 
vided by the system. PLAN* manuals contain all Information a teacher needs 
to beg'ln to use the PLAN* Individualized program. 

Teachers know exactly what students are expected to learn and what criteria 
to use In deciding whether or not a student has mastered an objective. 

Teachers are Informed of the dally progress of each student. A progress 
report shows the specific objectives each student has mastered, the ones 
he Is currently. working on and what Is still scheduled for him to do. 
Much of the teacher's Job of record keeping In PLAN* Is done by the com- 
puter. 

Teaching Learning Units (TLU'S) have been provided for each objective In 
PLAN*. Some TLU's are filed In the classroom. Others are stored In a 
special place In the building. Students may go to TLU storerooms to with- 
draw additional TLU's or objective tests under the direction of the teacher 
or administrator. A TLU spells out the objective the child wilt study, 



lists materials to use and activities to do In order to achieve the objec- 
tive. Teacher aides assist the teacher In monitoring the program. 

Some learning activities require students to work In small groups. Others 
require students to work alone. When a child feels he can master the ob- 
jective of a TLU, he Is tested Individually. Testing Is very Important In 
Individualized Instruction. Each child Is measured against his own poten- 
tial. 

Two Curriculum Writers have the challenging task of creating local TLU*s 
that are not available In the PLAN* curriculum. The writers work with the 
Division of Curriculum Services, PLAN* students, teachers and administra- 
tors. They have developed TLU's f c ^ the U. S. Constitution and Black 
Studies for the middle grades, Scott Foresman Systems, Levels 1,2,3,4 and 
they are working on completing Systems. ^ 

PROGRAM EVALUATION - E. Patterson 

This paper focuses on the results of the summatlve evaluation data prepared 
by the evaluator. A literature search was made prior to preparation of the 
evaluation model. The academic success of the program was evaluated using 
the Metropolitan Achievement Test In grades 1-3 and the Iowa Test of Basic 
Skills In grades 4-7. Affective measures used to determine the differences 
In the students self-esteem, general an#^ety and test anxiety. The effec- 
tiveness of various teaching" patterns In PLAN* classrooms were analyzed 
using the results of classroom observations. The Instructional program 
used In PLAfi* and Comparison classroorr.s was analyzed by the degree of 



satisfaction of administrative personnel, operational personnel and parents 
of students In PLAN*. Cost Analysis of both Instructional systems was 
studied and reported. Recommendations for the subsequent years are based 
on the analysis of the data gathered. 

The evaluation model was designed to examine how PLAN* teachers Implemented 
the Individualized learning system rather than observe differences between 
comparison and PLAN* classrooms. Previous research documented In ERIC 
publications Indicated that PLAN* teachers spend more time In Individual 
and small group Instruction than regular classroom situations. PLAN* teach- 
•r training emphasizes Individualized Instruction* Therefore this aspect 
of the study was not repeated In this evaluation. 

Two out of seven grjde levels did better academically with PLAN*, two grade 
levels Indicated no difference. Grade I and grade 3 achieved significantly 
better using PLAN* (See Exhibit I). Grade 4 and grade 6 achieved signifi- 
cantly better In Comparison classrooms (See Exhibit 2). The significance 
level In each case was greater than .01. (l;e. There Is less than I chance 
out of 100 that the distribution of scores would occur by chance alone). 
Grades 2,5 and 7 showed no significant differences In achievement between 
PLAN* and Comparison classrooms. 

The three affective measures used were the Self-Esteem Inventory (S.E.I.), 
General Anxiety Scale for Children (GASC) and the Test Anxiety Scale for 
Children (TASC). Three out of six grade levels had a higher self-estedm or 
less anxiety, In PLAN* classroom Instruction, one grade level showed less 
test anxiety and self esteem and two grades showed no significant difference. 



Primary students In grades I and 2 showed less anxiety In PLAN* classrooms 
than In Comparison classrooms (See Exhibit 3 - Comparison data for Grade 3 
unavailable.) Grade stx PLAN* students showed more self-esteem, grade 
four Comparison students showed more self-esteem and less test anxiety, 
grades 3 and 7 showed no statistically significant differences (See 
Exhibit 4). The level of significance for the comparisons discussed 
above are: 



Grade 1 


- GASC 


(Pbst Test) 


.023 


Grade 2 


- GASC 


(Post Test) 


.040 




TASC 


(Pretest) 


.021 




TASC 


(Pbst Test) 


.001 


Grade 4 


- SEI 


(Post Test) 


.004 




TASC 


(Pretest) 


.001 




TASC 


(Post Test) 


.001 


Grade 6 


- SEI 


(Pretest) 


.001 




SEI 


(Pbst Test) 


.001 



The most accurate measui*e of a PLAN* student*s academic achievement (In the 
evaluators opinion) seems to be weighted score derived from totaling the 
values assigned to each objective mastered. PLAN*-C curriculum Is a hier- 
archical structure of behavioral objectives with criterion measures for 
achievement aggregated Into learning units called modules. Modules may have 
as few as I objective or as many as 15. Each objective has a cognitive 
difficulty level based on Benjamin S. Bloom's Taxonomy of Educational 
Objectives* . The weighted score Is derived by totaling the objective 
values within each module mastered by each student (See Exhibit 5). This 
total mastered value (TMV) score was used for comparisons. Total mastered 
values correlate significantly with I TBS scores In 3 out of h grade levels. 
TMV correlates significantly with SEI Post Test scores In 2 out of 4 grades 



Benjamin S. Bloom, Taxonomy of Educational Objectives, 
David McKay Co., Inc., New York, 1956. 



levels. 7MV does not correlate significantly with 6ASC Post Test (either 

positively or negatively) at any grade level (grades 4-7). TMV correlates 

significantly with TASC Post Test scores In 2 out of 4 grade levels. The 

level of significance for the comparisons discussed above are: 

Grade 4 - ITBS Comp. G.E. with TMV .10 

Grade 5 - ITBS Comp. G.E. with TMV .02 ' 

Grade 6 - ITBS Comp. G.E. with TMV .01 

SEI (Post Test) with TMV .01 

TASC (Pbst Test) with TMV .01 

Grade 7 - SEI (Pbst Test) with TMV .01 ' . 

TASC (Pbst Test) with TMV .01 

No statistically significant difference was associated with observed teach- 
ing patterns and acade^nlc success. The data used was based on ITBS mean 
composite Grade Equivalent (G.E.) gain In grades 4-7. Eight out of the 
twelve classrooms showed a teaching pattern of relatively high Individual 
Interaction, low group Interaction and high classroom management activities. 
The other 4 classroom patterns showed relatively high Individual .Interaction 
somewhat lower group Interaction and a lower frequency of classroom manage- 
ment activities. 

In response to questionnaires, students In 12 but of 13 PLAN* classrooms 
Indicated higher satisfaction than did students In Control classrooms and 
teachers In all PLAN* classrooms Indicated higher relative satisfaction 
than did Control teachers. Based on a 5 point scale with 5 the most 
satisfaction and I the least, the mean response for PLAN* teachers was 

* 

3.78 and the mean response for O^ntrol teachers was 3.11. A Pearson pro- 
duct moment correlation (r) between the mean classroom scores on the ques- 
tionnaire and the Class Average Composite Grade Equivalent (G.E.) scores 
on ITBS Post Tests showed no statistical significance. All other categories 



of persons responding to questions regarding satisfaction with PLAN* were 



more favorable than unfavorable. Mean scores by categories responding were: 

PLAN* Principals 3.54 

PLAN* Administrative Assistants 3.64 

PLAN* Librarians! . 3.79 . 

PLAN* Teacher Aides 4.21 

PLAN* Terminal Operators 4.25 
Parents of Students In PLAN* • 

Classrooms 3.94 



The average cost per pupil for PLAN* students Is currently very high due to 
developmental start-up costs. As the program Is Implemented* costs decrease 
dramatical ly: 



1) Once materials have been purchased for a PLAN* classroom, the 
start-up costs disappear and normal financial operational costs 
return. 

2) **PLAN*-A** to be- Implemented In Fiscal Year I974» will cost 
only half what ••PLAN*-C" cost during Fiscal Year 1973. 

3) A test-run to determine feasibility by running PLAN* on the 
St. Louis computer facility Is scheduled for February.. Costs 
would decrease at that time. 

4) A decrease In the teacher to teacher aide ratio from one aide 
per teacher to one aide per two teachers was Implemented In 
f'^ptember, 1973. 

5) Writing modules for use with existing St. Louis tests will 
eventually decrease start-up costs (due to the fewer new 
materials required). 

6) The more student.- In PLAN*, the lower the cost per pupil 
' ratio becomes. 

7) The costs for PLAN* are expected to decrease during the 
project *s years to a point that the Board of Education 
can afford to Implement PLAN* In schools throughout the 
city at a cost not exceeding that of regular classrooms. 



Caution should be used In Interpretfng the 1st year data: 

I) The 1973 data Is contaminated In grades 4-7 due to the pre- 
test being given In the Spring and the post test being given 
the following year rather than Winter and Spring at the 
start and finish of the project's first year (The program 
had a mid-year start-up). 



Librarians In PLAN* schools. (There Is not a separate 
PLAN* library). 



2) The two grade levels showing significant gains with PLAN* 
*fere both primary and were measured with a different test and 
measured precisely the same amount of time the program was 

fji In operation rather than over a total year of half PLAN*, 

half regular classroom Instruction. (The evaluator feels 
that this measurement Is more reliable than the I TBS data). 

3) The two grade levels showing significant gains with Control 
classroom Instruction had the benefit of the District's 
Vocabulary Development Project (A city - wide program). 

. The effects of not using the Vocabulary Development 
Project should be studied along with other possible 
Inf li^nclng factors such as other special projects 
In operation. 

; • The possible use of Vocabulary Development project 
programs on an Individual basis at the option of the 
student and teacher should be explored. 

4) A follow - up on the Total Mastered Value (TMV) study 
(derived by totaling the values assigned to the cognitive 
level of the objectives successfully completed) should be 
undertaken by the evaluator during Fiscal 1974. 

• A conversion table should be secured from Westlnghouse 
Learning Corporation. (This Is needed to compare PLAN*-A 
and PLAN*-C). 

. A study of first-year sub-test scores on the I TBS should 
be Initiated by the evaluator to. determine how well students 
In PLAN* did by subject matter iareas. 



Use of affective measures should continue but the General Anxiety Scale for 
Children (GASC) will be discontinued. 

♦ 

1) The Instrurieht Is more home oriented than school oriented 
and correlates highly with the Test Anxiety Scale for 
Children (TASC). 

2) The Self -Esteem Inventory (SEI) tests should be continued. 

3) A different factor measured with another effective Instru- 
ment Is the "My Class". This measures . ay a student feels 
about his classmates and assesses the c i .inate of the learn- 
ing environment. 



Additional costing Information needs to be made available to facilitate 
cost benefit analysis: 

1) A more formal cost-benefit analysis should be undertaken 
by the evaluator for the second project year. 

2) A better system for gathering required data should be 
explored with appropriate divisions. 



Th© questionnaires used to measure satisfaction with the Instructional 



system should be revised. 

1) Sampling the population would probably be sufficient for 
analysis. 

2) Questionnaire responses should be machine scoreable. 
The test-run of data and the associated routing of cards and printouts 
must be proven before release of the Iowa City lines should be considered: 

1) Dally turnaround should be achieved each day for one month 
Implementation. 

2) Accuracy of the data stored and retrieved should be veri- 
fied dally for one month before Implementation. 

3) A five-year Implementation plan should be drafted by the 
Evaluation Division to be used following the first three 
project years should the project prove to be cost-effective 
and beneficial academically. 



The very short (about 4 months) start - up period was critical to the com- 
parisons ffinde. 

1) Both the positive and negative results should be treated 
very cautiously In Judging success of the program. 

2) At the end of the second year, results will be more 
reliable. 

PUN* ILLUSTRATED - G. Johnson 



Between the program description and evaluation results a vicarious trip 
through PLAN* classrooms was simulated through the use of a locally developed 
Slide/tape presentation and the Westlnghouse Learning Corporation's Teach- 
ing Learning Unit (TLU) Number 0800-1, "Seeing Is Believing". (See Sample.) 
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